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Abstract 

In this paper we have shall generalize Shearer's entropy inequal- 
ity and its recent extensions by Madiman and Tetali, and shall apply 
projection inequalities to deduce extensions of some of the inequali- 
ties concerning sums of sets of integers proved recently by Gyarmati, 
Matolcsi and Ruzsa. We shall also discuss projection and entropy 
inequalities and their connections. 



1 Introduction 

In 1949, Loomis and Whitney [10] proved a fundamental inequality bounding 
the volume of a body in terms of its (n — l)-dimensional projections. Over 
forty years later, this inequality was extended considerably by Bollobas and 
Thomason [3J: they showed that a certain 'box' is a solution of much more 
general isoperimetric problems. 

In 1978, Han [8] proved the exact analogue of the Loomis- Whitney in- 
equality for the entropy of a family {X\, . . . ,X n } of random variables, and 
in the same year Shearer proved (implicitly) a considerable extension of this 
inequality, namely the entropy analogue of the projection inequality that was 
to be used some years later in [3] to deduce the Box Theorem. (This extension 
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was published only in 1986, in pj.) Recently, Madiman and Tetali [TT| [T2] 
strengthened Shearer's inequality to a two-sided inequality concerning the 
joint entropy H(X 1 , . . . , X n ). 

In this paper we have two main aims. The first is to prove an entropy 
inequality that extends both sides of the Madiman- Tetali inequality Surpris- 
ingly, this inequality is not only much more general than the earlier inequal- 
ities, but is also just about trivial. Our second aim is to point out that the 
projection inequalities imply extensions of some very recent inequalities of 
Gyarmati, Matolcsi and Ruzsa [6] concerning sums of sets of integers. 

Our paper is organized as follows. In the next two sections we shall review 
some of the projection and entropy inequalities. In Section H] we shall prove 
our extremely simple but very general entropy inequality extending those of 
Shearer, and Madiman and Tetali. In Section [5] we shall turn to sumsets, and 
continue the work of Gyarmati, Matolcsi and Ruzsa. Finally, in Section [61 
we shall state some related unsolved problems. 



2 Projection inequalities 

As in [3], we call a compact subset of R n which is the closure of its interior 
a body, and write {ei, . . . , e n } for the canonical basis of E n . Given a body 
K C ]R n and a set A C [n] = {1, . . . , n} of d indices, we denote by Ka the 
orthogonal projection of K into the linear span of the vectors e^, i G A, and 
write \Ka\ for its (^-dimensional Euclidean volume. (In particular, Ky n ] = K.) 
The volumes \Ka\ can be viewed as a measure of the 'perimeter' of K. In 
1949, Loomis and Whitney [10] (see also [I], [U page 95] and [7J page 162]) 
proved the following isoperimetric inequality: 

n 

i^r^ni^Huoi- (!) 

i=l 

Close to fifty years later, Bollobas and Thomason [5] proved the following 
Box Theorem showing that for the set of projection volumes \Ka\, A C 
[n], the solution of the isoperimetric problem is a box, i.e., a rectangular 
parallelepiped whose sides are parallel to the coordinate axes. 

Theorem 1. Given a body K C W 1 , there is a box BCK" with \K\ = \B\ 
and \Ka\ > \Ba\ for every A C [n]. □ 
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This theorem is equivalent to the assertion that there exist constants 
ki > such that 

n 

\K\ = Yl k and \K A \ >\\h for all A C [n]. (2) 

8=1 i£A 

An immediate consequence of Theorem [T] is that, if the volume of a box can 
be bounded in terms of the volumes of a certain collection of projections, 
then the same bound will be valid for all bodies. In particular, the Loomis- 
Whitney Inequality ([1]) is an immediate consequence of the Box Theorem. 
In fact, the Box Theorem was deduced from the Uniform Cover Inequality, 
which is an even more obvious extension of ([T]). To state this inequality, we 
call a multiset A of subsets of [n] such that each element i G [n] is in at 
least k of the members of A a k- cover of [n]. A k-uniform cover or uniform 
k- cover is one in which every element is in precisely k members of A. Thus 
the sets [n] \ {i} appearing in the Loomis- Whitney inequality ([I]) form an 
(n — l)-uniform cover of [n]. The Uniform Cover Inequality states that if K 
is a body in M. n and A is a fc-uniform cover of [n] then 

\K\ k <JI \K A \. (3) 
AeA 

Clearly, the Uniform Cover Inequality is a trivial consequence of the Box 
Theorem. Uniformity is needed for Q to hold: if A is not /c-uniform, then 
([3]) does not hold for every body K, not even if A is a /c-cover. Indeed, if 
\Ka\ < 1 for some A, then we can add an arbitrary number of copies of A to 
A, making the right hand side of ([3]) arbitrarily small. 

By identifying a lattice point z G Z n with the unit cube Q z C W 1 with 
centre z, ([3]) implies that if S is a finite subset of Z n and Sa is the projection 
of S to the subspace spanned by {e^ : i G A}, then for every uniform fc-cover 
^4 of [n] we have 

\s\ k < n i^i- w 

In fact, in this inequality we do not have to demand that the fc-cover A = 
{Ai} is uniform: if A' C A then \Sa'\ < therefore, by removing elements 
from the sets Aj so as to obtain a uniform k-cover A' = {A'A- with C A iy 
wehave|^| fc <nj^|<nj^J. 
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3 Entropy Inequalities 



Let us turn to some entropy inequalities related to the projection inequalities 
above. As usual, we write H(X) for the entropy of a random variable X; in 
particular, if X is a discrete random variable, then 

H(X) = - P (* = *0 lo S 2 P(* = fe)- 

k 

It is easily seen that if X takes n values then H(X) < log 2 n, with equality if 
and only if X is uniformly distributed, i.e., takes every value with probability 
1/n. If X and Y are two discrete random variables, then the entropy of X 
conditional on Y is 

H(X \Y) = -J2 ¥ ( x = k,Y = 1) log 2 V(X = k\ Y = I). 

k,l 

The entropy satisfies the following basic inequalities: 

H(X,Y) = H(X\Y) + H(Y), (5) 
< H(X | Y) < H(X), (6) 
H(X \Y,Z)< H(X | Y), (7) 

where, for example, we write H(X, Y) for the entropy of the joint variable 
(X,Y). 

Analogously to our notation concerning projections, given a sequence 
X = (Xi, . . . , X n ) of n random variables, for A C [n] we write X& = (Xi) ie A- 
In 1978 Shearer proved the following analogue of ([3]) for entropy (the result 
was first published in [5]). Since H(Xa) is a monotone increasing function 
of A, in this inequality it makes no difference whether we take A to be a 
/c-cover or uniform /c-cover. 

Theorem 2. If A is a uniform k-cover of [n] then 

kH{X)<Y,H{X A ). (8) 

AeA 

A little earlier Han [8] had proved the 'Loomis- Whitney' form of The- 
orem [2j (n — l)H(X) < H(X\ n ]\u\). The first non-trivial case of this 
inequality is 2H(X, Y, Z) < H(X,Y) + H(X,Z) + H(Y,Z). Curiously, in 
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[5] it is remarked that this special case can be proved analogously to what 
we stated as Theorem [2J and so can the case when A is the collection of all 
/c-subsets of [n]. 

Some years after the publication of [3] it was noted that Theorem [2] implies 
Theorem [TJ In fact, the reverse implication is also easy: this follows from the 
fact that if pi, . . . , p n are fixed 'probabilities' with YlPi = 1 an d Npi is an 
integer for every i, then the number of sequences of length iV with Np,- t terms 
equal to i is 2 <Kl+ °^ H<yX ' >N , where X is a random variable with ¥(X = i) = pi. 
Given random variables X\, . . . , X n , we may assume that Xi takes values in 
Vi C Z, so that X = (Xi, . . . , X n ) takes values in V — V\ X • • • X V n , and 
there is an integer d such that d¥(X = v) is an integer for every v G V. Let 

be a multiple of d, and let S C V N C Z n7V be the set of all sequences in 
which v occurs precisely NF(X = v) times. For AC [n], write A C [nN] 
for the set of all coordinates of V N C Z nAr that correspond to one of the 
factors Vi, i & A. Then is the set of sequences in Vj^ where each value 
v G Va occurs NF(Xa = v) times. If A is a k uniform cover of [n] then 
A = {A : A G ^4} is a A; uniform cover of [nN] and so by Theorem [T] 

i^i* < n i^i- 

Thus 

2 fc(l+o(l))H(X)JV <- J~J 2 ( 1 + ( 1 ))^( X ^) 7V 

and Theorem [2] follows by letting — > oo. 

Recently, Madiman and Tetali [11], [12] strengthened Theorem [2] by re- 
placing the entropies H{Xa) by certain conditional entropies; furthermore, 
they also gave lower bounds for H(X). 

Theorem 3. Let X = (Xi)™ be a sequence of random variables with H(X) 
finite, and A a uniform k-cover of [n]. For A C [n] with minimal element 
a > 1 and maximal element b, set A* — {1, . . . , a — 1} and A* = {i ^ A : 
1 < i < b- 1}. T/ien 

^ i/(x A | < fcffpf) < ^ if(x A I x Am ). □ 

It should be noted that Theorem [3] does not follow from Shearer's In- 
equality, Theorem [2j 
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Trivially, in the lower bound A may be replaced by a fc-packing or a 
fractional fc-packing, and in the upper bound it may be replaced by a k- 
cover or a fractional /c-cover, with the obvious definitions. 

4 New Entropy Inequalities 

Since, as shown in [3], the Box Theorem follows from the Uniform Cover 
Inequality ([3]), one has a Box Theorem type strengthening of Shearer's In- 
equality; in fact, there is a similar strengthening of Theorem [3] as well. 

Theorem 4. Let X = (Xj)" be a sequence of random variables with H(X) 
finite. Then there are non-negative constants hi, . . . , h n such that H(X) = 

H(X A \ X A *) <J2 h * < h ( x a I X At ) for all A C [n\. 

Proof. We may take hi = H(Xi \ X^xj); to prove the inequalities, we induc- 
tively apply properties (JSHTJ). □ 

Although Theorem [3] does not follow from Theorem [2] (Shearer's Inequal- 
ity), as we shall see now, it does follow from a result which is extremely easy 
to prove but is still a considerable extension of Shearer's Inequality and a 
generalization of the submodularity of the entropy. Before we state this new 
inequality, we shall recall a consequence of the basic entropy inequalities, and 
introduce a partial order on the collection of multisets of subsets of [n]. 

First, from (j7j) and (jSJ) one can deduce that H(X A ) is a submodular func- 
tion of the set A: if A, B C [n] then 

H(X AUB ) + H(X AnB ) < H(X A ) + H(X B ). (9) 
To see this, note that by (171) we have 

H(X B \ A | X A ) < H(X B \ A | X AnB ); 
using (J5j) to expand the first and last terms, we get 

H(X AUB ) - H{X A ) < H(X B ) - H(X AnB ), 

which is (J9j). 
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Figure 1: The minimal compression A" of A = {{2, 3, 4}, {1, 3, 5}, {1, 2, 6}, 
{1,2}, {1,3}, {2}}. 



Second, let M. n ,m be the family of multisets of non-empty subsets of [n] 
with a total of m elements. Given a multiset A = {Ai, . . . , A^} G A4 n ,m 
with non- nested sets Aj and Aj (thus neither Aj C Aj nor Aj C Aj holds), 
let A' = A(ij) be obtained from A by replacing Ai and Aj by fl Aj and 
Aj U Aj, keeping only Aj U Aj if Aj fl Aj = 0. (If Aj and Aj are nested 
then replacing (Aj, Aj) by (Aj fl Aj, Aj U Aj) does not change A.) We call 
A' an elementary compression of A. Also, we call the result of a sequence of 
elementary compressions a compression. 

Let us define a partial order on M.( ntm ) by setting A > B if B is a 
compression of A. That ' >' defines a partial order on yW n/m follows from 
the fact that if A' is an elementary compression of A then 

AeA A&A' 

Note that for every multiset A G -M( njm ) there is a unique minimal multiset 
A* dominated by A consisting of the sets 

Aj = {i G [n] | i lies in at least j of the sets A G A}. 

Equivalently, A" is the unique multiset that is totally ordered by inclusion 
and has the same multiset union as A. If we renumber [n] in such a way that 
each Aj is an initial segment, then the AjS are just the rows of the Young 
tableaux associated with the set system A, as in Figure [TJ In particular, if 
A is a fc-uniform cover, then A" = fc{[n]}. 

Here is then our essentially trivial but general entropy inequality 
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Theorem 5. Let X = (Xj)™ be a sequence of random variables with H(X) 
finite, and let A and B be finite multisets of subsets of [n] . If A > B then 

Y,H{Xa)>Y, H ^ X b)- (10) 

AeA BeB 

Proof. All we have to check is that (TTUT) holds if B is an elementary compres- 
sion of A, i.e., if B = Auj) for some i and j, where A = {Ai, . . . , A e }. But 
then ffTO]) is equivalent to 

H(X Ai ) + H(X A .) > H(X AinAj ) + H{X AiUAj ), 

which holds by ([9]), the submodularity of the entropy. □ 

We dignify the special case of Theorem in which B is the minimal 
multiset A$ dominated by A by calling it a theorem. This is the inequality 
one is most likely to use. 

Theorem 6. Let X = (Xj)™ be a sequence of random variables with H(X) 
finite, and let A be a finite multiset of subsets of [n] . Then 

J2h(x a )<J2h(x a ). □ 

AeAi AeA 

Let us illustrate Theorem[5]with a simple example: as {{1, 2}, {1, 3}, {4}} > 
{{1,2, 3}, {1,4}}, 

H(X 1 , X 2 ) + H{X U X 3 ) + H(X 4 ) > H{X U X 2 , X 3 ) + H{X U X 4 ). 

Also, let us point out that even Theorem [6] is stronger than Theorem [3], the 
Madiman-Tetali inequality. 

Proof of Theorem\E^ Theorem^ Since H(X A | X B ) = H(X AuB )-H(X B ), 
the upper bound inequality is 

kH(X) + H(X A ,) < H(X AUA J, 
AeA AeA 

which follows from the fact that the multiset C\ = {A* : A 6 A} U &{[^]} is 
totally ordered and has the same multiset union as C 2 = {A U A* : A G A}, 
so C\ = C\. Similarly, the lower bound inequality is equivalent to 

J2 H(X AUA *) < J2 H ( X a*) + kH(X). 
AeA AeA 
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Figure 2: A body K made up of five unit cubes. Coordinate '1' is horizontal. 

which follows from the fact that the multiset C3 = {AUA* : A G A} is totally 
ordered and has the same multiset union as C 4 = {A* : A G A} U fc{[n]}, so 

c 3 = c\. a 

The inequality corresponding to Theorem [6J in terms of projections of 
bodies is false. For example, consider the set K in Figure [2j Then \K\ = 5, 
\K {1} \ = 2, but \K{i,2} \ = \K{i,S}\ = 3, so 

I ^{1,2,3} 1 1 -^{1} I > I K{1,2} 1 1 ^{1,3} I- 



5 Sumsets 

Let Si, . . . , S n be finite sets in a commutative semigroup with sum 
S — Si H 1- S n = {si H h s n : Si G Si for every i}. 

For A C [n] set 5a = SieA^' so ^ na ^ = ^ e sna ll think of 5 as 
an n-dimensional body in M n and 5a as its canonical projection into the 
subspace spanned by {e^ : i G A}. Gyarmati, Matolcsi and Ruzsa [B] proved 
the analogue of the Loomis- Whitney inequality in this context. In fact, the 
analogue of the Uniform Cover inequality and Box Theorem are just as easy 
to show. 

To see this, put an arbitrary linear order on each of the sets 5j. For 
each A = {ii, . . . , i r } C [n] define an embedding ip^ of 5a into the Cartesian 
product riieA ^ by mapping s G 5a to the lexicographically least element 
. . . , Si r ) of YlieA &i w ith coordinates summing to s. (In fact, there are 
many other orders we could choose instead of the lexicographic order: all 
we need is that the assertions below hold for these orders.) As shown by 
Gyarmati, Matolcsi and Ruzsa [Bj, the projection of 5' = <P[ n ](S[ n ]) into 
riieA ^ is contained in <£>a(5a)- To see this, note that if (si, . . . , s n ) G 5' 
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then any projection (sj 1; . . . , Sj r ) is lexicographically minimal with the same 

sum, since if a h + ■ ■ ■ + s ir = s' h H h s' ir with (s^, . . . , s' ir ) < (s h , . . . , s ir ), 

then si + ■ • • + s n = s[ H — ■ + s' n and (s[, . . . , s' n ) < (si, . . . , s n ) where s' { = Si 
if i ^ A. Thus |(<S")a| < = \Sa\- Now the following result is 

immediate from Theorem [1] applied to 5". 

Theorem 7. There are constants Ai, . . . , A n > suc/i i/iat 

n 

|5| = JjA, and \S A \ > ]]_Xi for all A C [n]. 

1 iGA 

In particular, if A is a uniform k-cover of [n] then 

i5i*<ni^i. □ 

AeA 

Using a similar approach, one can prove the following, which is stated 
(with a slight error) as an open problem in [B]. 

Theorem 8. If A, Bi, . . . ,Bk are finite sets of integers and C C B\ + ■ • ■ + 

Bfr, then 

k 

\A + C\ k < ICf- 1 JJ|A + Si|. (11) 

i=i 

Proof. For convenience, write n = k + 1 and 5 n = = A. Define maps 
7" C [n], as above. Let S' be <f[ n ](C + B n ). Then jS'ml < |C| and 
I'S'iin}! < | -Si + -B„|. The result follows by applying (BJ to S' and the fc- 
uniform cover of [n] consisting of the following 2k — 1 sets: the pairs {1, n}, 
{2, n}, . . . , {/c, n}, and the fc-set [n — 1] taken k — 1 times. □ 

One can have equality in Theorem El for example, if A = [n] , C = B\ = 
{0,n}, .E?2 = • • • = Bk = {0}. This shows that inequality ( TTTT) may break 
down if | C | fc 1 is replaced by \C\ l with i < k — 1. 

It is worth noting that one can prove a lower bound on |,S| which is 
additive in the \Sa\ in the case when the sets Si lie in a torsion free abelian 
group. This generalizes Theorem 1.1 of [6j. 

Theorem 9. // the sets Si lie in a torsion-free abelian group then there are 
subsets S'i C Si of cardinality at most 2 such that for any uniform k-cover 
A of [n] we have 

k(\S\-l)>k(\S'\-l)>J2(\SA\-l), 

AeA 
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where S' is the set of sums Si + ■ ■ ■ + s k £ S such that {i : Sj ^ S^'} C A for 
some A G A. 

Proof. We first note that any torsion-free abelian group can be given an 
ordering compatible with addition. 

Pack a k x n grid with the sets A E A in the obvious manner: each 
A = {ji, . . . ,j r } is packed as a set of pairs A' = ■ ■ ■ , (i r ,jr)} so that 

the A', A E A, are disjoint and cover the whole of [k] x [n\. The i k s are 
otherwise arbitrarily chosen. 

We may assume without loss of generality that the minimum elements of 
Si are all equal to 0. Let ai be the maximum element of Si. The set S^ will 
be chosen to be {0,aj}. For convenience write ax = XlieT a «- We shall mark 
k copies of S — {0} as follows. 

Process each element of [k] x [n] in the lexicographic order — i.e., 



Suppose we are processing Then = (h,jt) f° r some A e A. In 

the i'th copy of S' — {0}, mark all the elements that are in 



Note that all elements of a\j]-A + Sa lie in S' (indeed in SauU] n an< i' 
subtracting ayj-A) the number of elements marked is equal to the number of 
elements of Sa that lie in the interval 



(Note by assumption j E A so [j] — A = \j — 1] — A). Now it is clear that 
for distinct distinct elements are marked (since they all lie in the i'th 

copy of S' fl (%-].], %]] and these sets are distinct), so at most k(\S'\ — 1) 
elements are marked in total. (The element G S is not included in any of 
the intervals (au_i], am].) However, every element in Sa — {0} lies in some 
interval (ay-ijnA) a [j]nA] for some j G A, so results in some element being 
marked. Since it is clear that \S\ > \S'\, the result follows. □ 

Corollary 10. If the sets Si lie in a torsion-free abelian group then there 
exists constants o~i such that 



(l,l),...,(l,n),(2,l),...,(2,n) 



, (k,n). 



a [j]-A + S A n (a b -_i],a|j-]]. 



(%-i]rvl,%]rvl]- 



n 




and 




□ 



i=i 
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Theorem M fails for groups with torsion when, for example, all S, are 
equal to some non-trivial finite subgroup. If we insist that |S| is smaller 
than the order of the smallest non-trivial subgroup then we have the famous 
Cauchy-Davenport theorem, which can be written in the following form. 

Theorem 11. // Si, . . . , S n are non-empty subsets of Z p and S — Si + ■ ■ • + 

S n , then either \S\ > p or 



Theorem [TT] is the analogue of Corollary [TU] for the 1-uniform cover A = 
{{1}, . . . , {n}}, and can be extended to all finite (even non-abelian) groups 
as is shown in [9] and [13] (see also [2]). 

Theorem 12. // S\, . . . , S n are non-empty subsets of a finite group G and 
S = Si -k ■ ■ ■ -k S n (-k denoting the group operation), then either \S\ >p or 



Unfortunately, Theorem [12] does not generalize to more general covers. 
For example, if Si = S 2 = S 3 = {0, 1, 3, 5} C Z 13 then \Si + S 2 \ = \Si + S 3 \ = 
\S 2 + Ss\ =9 and \Si + S2 + = 12, so 

2(151 + ^2 + S 3 \ - 1) < (\Si + S 2 \ - 1) + (|Si + S 3 \ - 1) + (\S 2 + S 3 \ - 1). 

6 Conjectures 

The most obvious problems related to the results above concern general (not 
necessarily commutative) groups. In fact, Ruzsa has already asked whether 
a suitable analogue of the inequality corresponding to the Loomis-Whitney 
inequality holds for all groups. It is not unreasonable to hope that the 
analogue of the Box Theorem (or Cover Inequality) holds as well, as does the 
extension of Corollary [10] To state these conjectures, given finite non-empty 
sets Si, . . . , S n in a group G with operation -k as above, and a set A C [n], 
write Na for the maximal number of elements in a product set obtained from 
Si * ■ • ■ -k S n by replacing each Si, i ^ A, by a single element of Sj. Similarly, 
write ua for the corresponding minimum. 




□ 



S| - 1 > - !)■ 



where p is the smallest prime dividing \G\. 



□ 
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Conjecture 13. Let Si, . . . ,S n be non-empty finite subsets of a group. Set 
S = Si*- ■ -kS n , and let be as above. Then there are constants Ai, . . . , A n > 
such that 

n 

\S\=Y[Xi and N A >Y[\i for all AQ[n\. □ 

1 i£A 

Conjecture 14. Let Si, . . . ,S n be non-empty finite subsets of a group, and 
let S and be as above. Then there are constants such that 

n 

\S\ — 1 = <7j and ua — 1 < o~i for all AC [n]. 

i=l i<=A 

In conclusion, we should say that both these conjectures are rather ten- 
tative: we would not be amazed if they turned out to be false. 
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